MLPnP - A Real-Time Maximum Likelihood Solution to the Perspective-n-Point Problem

In this paper, a statistically optimal solution to the Perspective-n-Point (PnP) problem is presented. Many solutions to the PnP problem are geometrically optimal, but do not consider the uncertainties of the observations. In addition, it would be desirable to have an internal estimation of the accuracy of the estimated rotation and translation parameters of the camera pose. Thus, we propose a novel maximum likelihood solution to the PnP problem, that incorporates image observation uncertainties and remains real-time capable at the same time. Further, the presented method is general, as is works with 3D direction vectors instead of 2D image points and is thus able to cope with arbitrary central camera models. This is achieved by projecting (and thus reducing) the covariance matrices of the observations to the corresponding vector tangent space.Comment: Submitted to the ISPRS congress (2016) in Prague. Oral Presentation. Published in ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., III-3, 131-13

Real Time Airborne Monitoring for Disaster and Traffic Applications

Remote sensing applications like disaster or mass event monitoring need the acquired data and extracted information within a very short time span. Airborne sensors can acquire the data quickly and on-board processing combined with data downlink is the fastest possibility to achieve this requirement. For this purpose, a new low-cost airborne frame camera system has been developed at the German Aerospace Center (DLR) named 3K-camera. The pixel size and swath width range between 15 cm to 50 cm and 2.5 km to 8 km respectively. Within two minutes an area of approximately 10 km x 8 km can be monitored. Image data are processed onboard on five computers using data from a real time GPS/IMU system including direct georeferencing. Due to high frequency image acquisition (3 images/second) the monitoring of moving objects like vehicles and people is performed allowing wide area detailed traffic monitoring

3D classification of crossroads from multiple aerial images using markov random fields

The precise classification and reconstruction of crossroads from multiple aerial images is a challenging problem in remote sensing. We apply the Markov Random Fields (MRF) approach to this problem, a probabilistic model that can be used to consider context in classification. A simple appearance-based model is combined with a probabilistic model of the co-occurrence of class label at neighbouring image sites to distinguish up to 14 different classes that are relevant for scenes containing crossroads. The parameters of these models are learnt from training data. We use multiple overlap aerial images to derive a digital surface model (DSM) and a true orthophoto without moving cars. From the DSM and the orthophoto we derive feature vectors that are used in the classification. One of the features is a car confidence value that is supposed to support the classification when the road surface is occluded by static cars. Our approach is evaluated on a dataset of airborne photos of an urban area by a comparison of the results to reference data. Whereas the method has problems in distinguishing classes having a similar appearance, it is shown to produce promising results if a reduced set of classes is considered, yielding an overall classification accuracy of 74.8%

Automatic Vehicle Detection in Aerial Image Sequences of Urban Areas using 3d Hog Features

With the development of low cost aerial optical sensors having a spatial resolution in the range of few centimetres, the traffic monitoring by plane receives a new boost. The gained traffic data are very useful in various fields. Near real-time applications in the case of traffic management of mass events or catastrophes and non time critical applications in the wide field of general transport planning are considerable. A major processing step for automatically provided traffic data is the automatic vehicle detection. In this paper we present a new processing chain to improve this task. First achievement is limiting the search space for the detector by applying a fast and simple pre-processing algorithm. Second achievement is generating a reliable detector. This is done by the use of HoG features (Histogram of Oriented Gradients) and their appliance on two consecutive images. A smart selection of this features and their combination is done by the Real AdaBoost (Adaptive Boosting) algorithm. Our dataset consists of images from the 3K camera system acquired over the city of Munich, Germany. First results show a high detection rate and good reliability

Traffic Monitoring without single Car Detection from optical airborne Images

This article describes several methods for traffic monitoring from airborne optical remote sensing data. These methods classify the traffic into free flowing traffic, traffic congestion and traffic jam. Furthermore a method is explained, which provides information about the average speed of dense traffic on a defined part of the road. All methods gather the information directly from image features, without the use of single vehicle detection. The classification of the traffic is done by stacking at least three overlapping images on top of each other and calculating the standard deviation of the gray values of each overlying pixel. In addition to that a texture analysis is implemented to differentiate the traffic. The average speed of dense traffic is calculated employing disparities of two following images of the same scene. All methods, which were presented in this article were tested on various data sets and compared with interactive measured reference data. These methods will be applicable in combination with methods using single car detection in the ARGOS-Project (AiRborne wide area hiGh altitude mOnitoring System)

Real time camera system for disaster and traffic monitoring

A real time airborne monitoring system for monitoring of natural disasters, mass events, and large traffic disasters was developed in the last years at the German Aerospace Center (DLR). This system consists of an optical wide-angle camera system (3K system), a SAR sensor, an optical and microwave data downlink, an onboard processing unit and ground processing station with online data transmission to different end user portals. The development of the real time processing chain from the data acquisition to the ground station is still a very challenging task. In this paper, an overview of all relevant parts of the airborne optical mapping system is given and selected system processes are addressed and described in more detail. The experiences made in the flight campaigns of the last years are summarized with focus on the image processing part, e.g. reached accuracies of georeferencing and status of the traffic processors

Motion component supported Boosted Classifier for car detection in aerial imagery

Research of automatic vehicle detection in aerial images has been done with a lot of innovation and constantly rising success for years. However information was mostly taken from a single image only. Our aim is using the additional information which is offered by the temporal component, precisely the difference of the previous and the consecutive image. On closer viewing the moving objects are mainly vehicles and therefore we provide a method which is able to limit the search space of the detector to changed areas. The actual detector is generated of HoG features which are composed and linearly weighted by AdaBoost. Finally the method is tested on a motorway section including an exit and congested traffic near Munich, Germany

An Operational System for Estimating Road Traffic Information from Aerial Images

Given that ground stationary infrastructures for traffic monitoring are barely able to handle everyday traffic volumes, there is a risk that they could fail altogether in situations arising from mass events or disasters. In this work, we present an alternative approach for traffic monitoring during disaster and mass events, which is based on an airborne optical sensor system. With this system, optical image sequences are automatically examined on board an aircraft to estimate road traffic information, such as vehicle positions, velocities and driving directions. The traffic information, estimated in real time on board, is immediately downlinked to a ground station. The airborne sensor system consists of a three-head camera system, a real-time-capable GPS/INS unit, five industrial PCs and a downlink unit. The processing chain for automatic extraction of traffic information contains modules for the synchronization of image and navigation data streams, orthorectification and vehicle detection and tracking modules. The vehicle detector is based on a combination of AdaBoost and support vector machine classifiers. Vehicle tracking relies on shape-based matching operators. The processing chain is evaluated on a large number of image sequences recorded during several campaigns, and the data quality is compared to that obtained from induction loops. In summary, we can conclude that the achieved overall quality of the traffic data extracted by the airborne system is in the range of 68% and 81%. Thus, it is comparable to data obtained from stationary ground sensor networks

Real Time Airborne Monitoring for Disaster and Traffic Applications

Remote sensing applications like disaster or mass event monitoring need the acquired data and extracted information within a very short time span. Airborne sensors can acquire the data quickly and on-board processing combined with data downlink is the fastest possibility to achieve this requirement. For this purpose, a new low-cost airborne frame camera system has been developed at the German Aerospace Center (DLR) named 3K-camera. The pixel size and swath width range between 15 cm to 50 cm and 2.5 km to 8 km respectively. Within two minutes an area of approximately 10 km x 8 km can be monitored. Image data are processed onboard on five computers using data from a real time GPS/IMU system including direct georeferencing. Due to high frequency image acquisition (3 images/second) the monitoring of moving objects like vehicles and people is performed allowing wide area detailed traffic monitoring